Display control apparatus, display control method, and program

ABSTRACT

A display control apparatus includes a receiving unit that receives a television broadcast signal containing at least remote broadcast image information, a display unit that displays image information, a recording and reproducing unit that records and reproduces the image information, a player information acquiring unit that acquires, from the remote broadcast image information, player information regarding players in a sports game included in a broadcast image signal, and a recording and reproducing control function unit that receives an audio signal contained in the broadcast signal, generates an excitation graph representing the level of excitation of the sports game along a time line, and records the excitation graph, the image of the game, time information, and the player information in the recording and reproducing unit. Upon receiving information indicating a break in the sports game, the recording and reproducing control function unit displays the excitation graph together with the recorded image.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority from Japanese Patent ApplicationNo. JP 2008-243073 filed in the Japanese Patent Office on Sep. 22, 2008,the entire content of which is incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a display control apparatus, a displaycontrol method, and a program capable of processing a moving image of asports game, such as a soccer game in which players chase a movingobject to be propelled in the sports game (e.g., a ball) to score.

2. Description of the Related Art

A soccer game has become more and more popular in recent years.Accordingly, soccer games have been broadcasted on television.

Not only Japanese domestic soccer games but also foreign soccer games(e.g., league games in European countries and countries in SouthAmerica, world cup games, preliminary rounds of European championship,and the championship game) have been broadcasted on television.

In addition, with technical advance of television display devices, suchas liquid crystal monitors, and with an increase in the size oftelevision display devices, video of soccer games including fast motionshas been naturally displayed. For example, skillful dribbling andshooting scenes can be clearly and beautifully broadcasted and displayedon television display devices.

SUMMARY OF THE INVENTION

In general, out-of-door games, such as soccer games, are played on alarge field. Accordingly, since it is necessary that a television cameracapture the image of a wide area of the field or an area in the vicinityof a ball (the moving object to be propelled in the game), thetelevision camera is placed at a relatively high position relative tothe stadium.

Accordingly, while the game is being played, an image of a wide area ofthe field or a small area near the ball is displayed, and a panning,tilting, or zoom operation is performed when the image is captured, ifnecessary.

For example, a zoom-in operation is performed on a player who has justscored a goal or an area in which a player committed a foul. Such azoom-in operation is widely performed, and the zoom-in operationsatisfies viewers of a soccer TV broadcast.

However, in general, soccer TV broadcasts tend to show a large area ofthe field, and it is difficult for viewers to identify individualplayers.

In addition, viewers (users) who want to watch a specific player desireto zoom in the player by themselves and enjoy the game.

In order to identify individual players playing in the large field, thenames of the players may be displayed in the vicinity of the heads ofthe players in a screen. However, with this method, the viewers may notenjoy the game.

In addition, a soccer game has a rule called offside. However, in manycases, it is difficult for the viewer to recognize the offside line.Furthermore, in some cases, it is difficult for the viewer to trace themotion and trajectory of a ball.

Still furthermore, during a 90-minute game period, onlookers are oftenwildly excited (e.g., at a goal scene). In such a case, it is difficultfor the viewers to immediately watch the scene in a recorded video.

Accordingly, the present invention provides a display control apparatus,a display control method, and a program that allows a viewer to displaydesired information associated with a game on a screen during a gamebroadcast.

According to an embodiment of the present embodiment, a display controlapparatus includes a receiving unit configured to receive a televisionbroadcast signal containing at least remote broadcast image information,a display unit configured to display image information contained in thetelevision broadcast signal, a recording and reproducing unit configuredto record and reproduce the image information, a player informationacquiring unit configured to acquire, from the remote broadcast imageinformation, player information regarding players in a sports gameincluded in a broadcast image signal, and a recording and reproducingcontrol function unit configured to receive an audio signal contained inthe television broadcast signal and generate an excitation graphrepresenting a level of excitation of the broadcast sports game along atime line of the image. The recording and reproducing control functionunit associates the generated excitation graph with the image of thesports game, time information, and the player information and recordsthe generated excitation graph, the image of the sports game, the timeinformation, and the player information in the recording and reproducingunit. Upon receiving information indicating a break in the sports game,the recording and reproducing control function unit instructs thedisplay unit to display the excitation graph together with the image ofthe sports game recorded in the recording and reproducing unit.

The recording and reproducing control function unit can instruct thedisplay unit to display the player information and the excitation graphtogether with the image of the sports game recorded in the recording andreproducing unit.

The recording and reproducing control function unit can instruct thedisplay unit to display a live image together with the image of thesports game, the player information, and the excitation graph recordedin the recording and reproducing unit.

The recording and reproducing control function unit can instruct thedisplay unit to display the excitation graph so that one ofpredetermined time periods along the time line of the graph isselectable.

The recording and reproducing control function unit can instruct thedisplay unit to display the player information so that the playerinformation regarding one of the players is selectable, and, uponreceiving an instruction to select a time period for which the selectedand displayed player appears in the broadcast image, the recording andreproducing control function unit can reproduce the recorded imagecorresponding to the selected time period and instruct the display unitto display the reproduced image.

According to another embodiment of the present invention, a displaycontrol method includes the steps of receiving a television broadcastsignal containing at least remote broadcast image information,displaying image information contained in the television broadcastsignal on a display unit, acquiring, from the remote broadcast imageinformation, player information regarding players in a sports gameincluded in a broadcast image signal, receiving an audio signalcontained in the television broadcast signal and generating anexcitation graph representing a level of excitation of the broadcastsports game along a time line of the image, associating the generatedexcitation graph with the image of the sports game, time information,and the player information and recording the generated excitation graph,the image of the sports game, the time information, and the playerinformation in a recording and reproducing unit, and, upon receivinginformation indicating a break in the sports game, displaying, on thedisplay unit, the excitation graph together with the image of the sportsgame recorded in the recording and reproducing unit.

According to still another embodiment of the present invention, aprogram includes program code for causing a computer to execute adisplay control process. The display control process includes the stepsof receiving a television broadcast signal containing at least remotebroadcast image information, displaying image information contained inthe television broadcast signal on a display unit, acquiring, from theremote broadcast image information, player information regarding playersin a sports game included in a broadcast image signal, receiving anaudio signal contained in the television broadcast signal and generatingan excitation graph representing a level of excitation of the broadcastsports game along a time line of the image, associating the generatedexcitation graph with the image of the sports game, time information,and the player information and recording the generated excitation graph,the image of the sports game, the time information, and the playerinformation in a recording and reproducing unit, and, upon receivinginformation indicating a break in the sports game, displaying, on thedisplay unit, the excitation graph together with the image of the sportsgame recorded in the recording and reproducing unit.

According to the present invention, for example, the receiving unitreceives a television broadcast signal containing remote broadcast imageinformation of a sports game, and the received remote broadcast image isdisplayed on the display unit. In addition, the player informationacquiring unit acquires player information from the receivedinformation. The acquired player information is supplied to therecording and reproducing control function unit.

The recording and reproducing control function unit receives an audiosignal contained in the television broadcast signal and generates anexcitation graph representing a level of excitation of the broadcastsports game along a time line of the image. The recording andreproducing control function unit associates the generated excitationgraph with the image of the sports game, time information, and theplayer information and records the generated excitation graph, the imageof the sports game, the time information, and the player information inthe recording and reproducing unit. Upon receiving informationindicating a break in the sports game, the recording and reproducingcontrol function unit instructs the display unit to display theexcitation graph together with the image of the sports game recorded inthe recording and reproducing unit.

According to the present invention, a service that allows a viewer toimmediately acquire desired additional information while watching a TVbroadcast image can be provided.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an exemplary configuration of adisplay control apparatus according to an embodiment of the presentinvention;

FIG. 2 is a schematic illustration of a display device of the displaycontrol apparatus according to the embodiment of the present invention;

FIG. 3 is a block diagram illustrating an exemplary configuration of aposition information acquiring unit according to the embodiment;

FIG. 4 is a functional block diagram of a main portion of an OSD controlcircuit according to the embodiment;

FIG. 5 illustrates an example of a display screen of the display deviceincluding a sub-display area;

FIG. 6 illustrates a screen in which a cursor is set on a selectedplayer;

FIG. 7 illustrates a first example of a zoom-in operation performed on aplayer selected using a cursor;

FIG. 8 illustrates a second example of a zoom-in operation performed ona player selected using a cursor;

FIG. 9 illustrates a screen in which a cursor is set on a ball;

FIG. 10 is a diagram illustrating an example in which player information(the names and the uniform numbers) of only players located in thevicinity of a ball are displayed;

FIG. 11 is a diagram illustrating a first example in which an offsideline and a ball trajectory are displayed;

FIG. 12 is a diagram illustrating a second example in which an offsideline and a ball trajectory are displayed;

FIG. 13 illustrates an example of a screen generated by a recording andreproducing unit and displayed on the display device;

FIGS. 14A to 14D illustrate an exemplary configuration of a remotecommander according to the present embodiment;

FIG. 15 is a first flowchart illustrating the operation performed by thedisplay control apparatus according to the embodiment;

FIG. 16 is a second flowchart illustrating the operation performed bythe display control apparatus according to the embodiment;

FIG. 17 is a third flowchart illustrating the operation performed by thedisplay control apparatus according to the embodiment;

FIG. 18 is a fourth flowchart illustrating the operation performed bythe display control apparatus according to the embodiment;

FIG. 19 is a fifth flowchart illustrating the operation performed by thedisplay control apparatus according to the embodiment;

FIG. 20 is a sixth flowchart illustrating the operation performed by thedisplay control apparatus according to the embodiment; and

FIG. 21 is a seventh flowchart illustrating the operation performed bythe display control apparatus according to the embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Various exemplary embodiments of the present invention are describedbelow with reference to the accompanying drawings.

FIG. 1 is a block diagram illustrating an exemplary configuration of adisplay control apparatus according to an embodiment of the presentinvention. FIG. 2 is a schematic illustration of a display device of thedisplay control apparatus according to an embodiment of the presentinvention.

According to the present embodiment, a display control apparatus 10includes a display device 20, a speaker 30, a television (TV) antenna40, a control unit 50, a remote commander 60 serving as an operationunit, a light receiving unit 70, and a recording and reproducing unit80.

The display device 20 serving as a display unit is formed from a flatdisplay, such as a liquid crystal display device or an organicelectroluminescence (EL) device. As shown in FIG. 2, the display device20 has a horizontally long aspect ratio. For example, the aspect ratioof the display device 20 is 16:9.

Sound output from the speaker 30 is controlled by the control unit 50that receives a television (TV) broadcast signal.

The control unit 50 receives a TV broadcast signal via the TV antenna 40and decodes an audio signal and a video signal. Thereafter, the controlunit 50 controls the speaker 30 to output sound based on the audiosignal. In addition, the control unit 50 controls the display device 20to display a broadcast video based on the TV broadcast signal tuned by aviewer (a user).

According to the present embodiment, the control unit 50 has thefollowing various functions.

The control unit 50 has a function of acquiring, from broadcast videoinformation, player information regarding a player of a game included ina broadcast video signal, for example, a soccer game. The control unit50 further has a function of acquiring field information using acorrespondence between a line in the broadcast video and a field model.

Still furthermore, the control unit 50 has a function of acquiringplayer position information regarding a player's position from the videosignal on the basis of the player information and the field information.Yet still furthermore, the control unit 50 has a function of acquiringinformation regarding the position of a ball serving as a moving objectto be propelled in the game from the video signal on the basis of thefield information and a function of displaying the player information onthe display device 20.

When displaying the player information, the control unit 50 has afunction of arranging a plurality of player information items anddisplaying the player information items in part of a display area.

In addition, the control unit 50 can display the player information foreach team. The control unit 50 can display a player information itemindicated by a cursor in a different way from the other playerinformation items (e.g., highlight display).

Hereinafter, the descriptions are made with reference to a ball servingas a moving object to be propelled in the sports game.

Furthermore, the control unit 50 has a function of setting a cursor on aplayer selected by provided player information and displayed on thedisplay device 20 using the player position information. Stillfurthermore, the control unit 50 has a function of setting a cursor on aball that is selected to be indicated by the cursor.

Furthermore, the control unit 50 has a function of, upon receiving aninstruction to display player information, displaying the playerinformation in the vicinity of the player on the basis of the ballposition information, the player position information, and the playerinformation. At that time, the control unit 50 can display the playerinformation in the vicinity of each of the players located in apredetermined area, at the center of which is the ball.

Still furthermore, the control unit 50 has a function of, after a cursoris set on an object, such as a player or a ball, automatically trackingthe object when the object moves. Upon receiving a zoom instruction, thecontrol unit 50 including an auto tracking control function sub-unitenlarges and displays at least the area indicated by the cursor.

Still furthermore, the control unit 50 has a function of forming a lineregarding the ball, such as an offside line of soccer or a trajectory ofthe ball, using the ball position information, the player positioninformation, the player information, and the field information. Thecontrol unit 50 forms an offside line having a predetermined width, nota simple line.

Still furthermore, the control unit 50 has a function of receiving theaudio signal in the television broadcast signal and creating anexcitation graph indicating an excitation level of the broadcast gamewith respect to a time line of the broadcast video. The control unit 50associates the created excitation graph with time information and theplayer information and records the excitation graph in the recording andreproducing unit 80 together with the video of the game.

Upon receiving information indicating game interruption, such as ahalftime break, the control unit 50 instructs the display device 20 todisplay a live image, the player information, and the excitation graphtogether with the video of the game recorded in the recording andreproducing unit 80.

The control unit 50 can selectively display the excitation graph foreach of predetermined periods of time in the time line. Alternatively,the control unit 50 selectively displays the player information items.Upon receiving an instruction to select the periods in which a selectedand displayed player appears in the broadcast image, the control unit 50plays back and displays the recorded video for the selected periods.

As shown in FIG. 1, the control unit 50 having such functions includes aTV tuner 51 and an audio decoding circuit 52. The control unit 50further includes a video decoding circuit 53, a superimposing circuit54, a player information acquiring unit 55, a field informationacquiring unit 56, a position information acquiring unit 57, amicrocomputer (μ-Com) 58, and an on-screen display (OSD) control circuit59.

Under the control of the microcomputer 58, the TV tuner 51 receives anddemodulates a TV broadcast signal of a selected TV broadcast channel.Thereafter, the microcomputer 58 supplies the audio signal to the audiodecoding circuit 52 and supplies the video signal to the video decodingcircuit 53.

Note that, under the control of the microcomputer 58, the receivedbroadcast signal is recorded in the recording and reproducing unit 80,and the recorded information is reproduced and displayed on the displaydevice 20.

The audio decoding circuit 52 decodes the audio signal and outputs thedecoded audio signal to the speaker 30. In addition, the audio decodingcircuit 52 supplies an audio signal AUD to an OSD control circuit 59.

Under the control of the microcomputer 58, the video decoding circuit 53decodes the video signal to generate a decoded video signal PCTR.Thereafter, the video decoding circuit 53 supplies the decoded signalPCTR to the superimposing circuit 54, the player information acquiringunit 55, the field information acquiring unit 56, and the positioninformation acquiring unit 57.

By using the OSD control circuit 59, the superimposing circuit 54superimposes, on the display device 20, various information (e.g., acursor, the name of a player, the uniform number of the player, anoffside line, or a ball trajectory image serving as additionalinformation) over the signal PCTR output from the video decoding circuit53. Thereafter, the superimposing circuit 54 displays the image.

The superimposing circuit 54 has a function of superimposing, using theOSD control circuit 59, the excitation graph over a playback videoreproduced by the recording and reproducing unit 80 and displaying theimage on the display device 20.

The player information acquiring unit 55 acquires the ball gameinformation included in the broadcast video signal, such as playerinformation IPLY regarding players (start players and reserve players)of the two soccer teams. Thereafter, the player information acquiringunit 55 stores the player information IPLY.

The player information IPLY acquired by the player information acquiringunit 55 includes the names of the players, the uniform numbers of theplayers, and photos of the faces of the players.

The player information acquiring unit 55 supplies the acquired andstored player information IPLY to the field information acquiring unit56 and the OSD control circuit 59.

The field information acquiring unit 56 acquires field information IFLDfrom an unedited TV broadcast video of a soccer game using acorrespondence between a line in an input image and a field model.Thereafter, the field information acquiring unit 56 stores the fieldinformation IFLD and, subsequently, supplies the acquired and storedfield information IFLD to the field information acquiring unit 56 andthe OSD control circuit 59.

The position information acquiring unit 57 acquires, from the videosignal PCTR of the soccer TV broadcast, ball position information IBLPregarding a ball located inside or outside the field using the fieldinformation IFLD and position information IPLYP regarding each of theplayers on the basis of the field information IFLD and the playerinformation IPLY. Thereafter, the position information acquiring unit 57supplies the acquired ball position information IBLP and the playerposition information IPLYP to the OSD control circuit 59.

FIG. 3 is a block diagram illustrating an exemplary configuration of theposition information acquiring unit 57 according to the presentembodiment.

As shown in FIG. 3, the position information acquiring unit 57 includesa ball position information acquiring sub-unit 571 serving as amoving-object position information acquiring unit and a player positioninformation acquiring sub-unit 572.

The ball position information acquiring sub-unit 571 acquires, from thevideo signal. PCTR of the soccer TV broadcast, the position informationIBLP regarding the ball located inside or outside the field using thefield information IFLD. Thereafter, the ball position informationacquiring sub-unit 571 supplies the acquired position information IBLPto the OSD control circuit 59.

The player position information acquiring sub-unit 572 acquires, fromthe video signal PCTR of the soccer TV broadcast, the player informationIPLYP regarding each of the players located inside or outside the fieldusing the field information IFLD and the player information IPLY.Thereafter, the player position information acquiring sub-unit 572supplies the acquired position information IPLYP to the OSD controlcircuit 59.

For example, in order to acquire the position information in the ballposition information acquiring sub-unit 571 and the player positioninformation acquiring sub-unit 572, a technology such as but not limitedto the technology described in the following Non-Patent document can beapplied:

The Institute of Electronics, Information and Communication EngineersReport, PRMU, Image Recognition and Media Understanding, Technicalreport of IEICE. PRMU, Vol. 103, No. 585 (20040116), pp. 95-100,PRMU2003-214, The Institute of Electronics, Information andCommunication Engineers, ISSN: 09135685

In such a case, the position information acquiring unit 57 computes,from unedited TV broadcast image of a soccer game, a homography matrixusing a correspondence between a line in the input video signal and afield model. The position information acquiring unit 57 then estimatesthe ball position and the player positions in the field.

Unlike video captured by a fixed camera, TV broadcast video includesmoving images obtained through panning, tilting, and zoom operations.Accordingly, the homography matrix changes as time passes.

Therefore, in order to compute the homography matrix, the positioninformation acquiring unit 57 compares the correspondences between linesin the video and the field model with each other in a space generated byparameters of Hough transform. Thus, the position information acquiringunit 57 computes a correspondence between the lines and estimates thehomography matrix and, subsequently, estimates the ball position and theplayers' positions in the field.

For example, the ball position information and the player positioninformation acquired by the position information acquiring unit 57during the game play are recorded in the recording and reproducing unit80 together with the time information and the excitation graph while thevideo is being recorded.

In response to an instruction signal received from the remote commander60, the microcomputer 58 controls the control unit 50 functioning as aTV receiver. In response to an instruction signal received from theremote commander 60, the microcomputer 58 changes a channel or controlsthe volume.

In addition, the microcomputer 58 analyzes a signal input from theremote commander 60. In accordance with the analysis processing, themicrocomputer 58 sends, to the OSD control circuit 59, an instruction togenerate various information, such as a cursor, the name of a player,the uniform number of the player, the offside line, or the trajectory ofthe ball serving as additional information, and an instruction regardingOSD display.

In response to a command CMD of the microcomputer 58, the OSD controlcircuit 59 generates a variety of OSD video signals for displayingicons, characters, and figures in the display screen. The OSD controlcircuit 59 then outputs the OSD video signals to the superimposingcircuit 54.

In addition, in response to a command CMD of the microcomputer 58, theOSD control circuit 59 generates various information, such as a cursor,the name of a player, the uniform number of the player, the offsideline, the trajectory of the ball, an excitation graph, and a photo ofthe face of the player serving as additional information.

Subsequently, the OSD control circuit 59 outputs the generated OSD videosignals to the superimposing circuit 54.

The video based on the OSD video signals is superimposed over the videobased on the TV video signal output from the video decoding circuit 53by the superimposing circuit 54. The video is then output to the displaydevice 20.

In addition, the OSD control circuit 59 has a sub-display function ofdisplaying, in response to the command CMD received from themicrocomputer 58, the photos of the faces and the names of the playersfor each of the teams in a predetermined sub-area of the display areawhen, for example, TV broadcast video of a soccer game is displayed onthe display device 20.

FIG. 4 is a functional block diagram of a main portion of the OSDcontrol circuit 59 according to the present embodiment.

As shown in FIG. 4, the OSD control circuit 59 includes a sub-displaycontrol function unit 591, a cursor control function unit 592, anautomatic tracking control function unit 593, a player informationcontrol function unit 594, an offside line control function unit 595, aball trajectory control function unit 596, and a recording andreproducing control function unit 597.

The sub-display control function unit 591, the cursor control functionunit 592, the automatic tracking control function unit 593, the playerinformation control function unit 594, the offside line control functionunit 595, the ball trajectory control function unit 596, and therecording and reproducing control function unit 597 are connected to abus 598.

Note that the sub-display control function unit 591 functions as aplayer information providing unit. In addition, the offside line controlfunction unit 595 and the ball trajectory control function unit 596function as a line forming unit.

In addition, the sub-display control function unit 591 has a function ofdisplaying, in response to the command CMD received from themicrocomputer 58, the photos of the faces and the names of the playersfor each of the teams in a predetermined sub-area of the display areawhen, for example, TV broadcast video of a soccer game is displayed onthe display device 20.

Note that the sub-display function is started in response to asub-display command CMD submitted by the microcomputer 58 when a userselects a favorite mode using, for example, the remote commander 60.

FIG. 5 illustrates an example of a display screen of the display deviceincluding a sub-display area.

In the example of FIG. 5, a sub-display area 220 is formed and displayedin the lower section of a main display area 210 in a display area 21 ofthe display device 20.

A score display area 221 used for displaying the score of the game isprovided in the middle of the sub-display area 220. Display areas 222and 223 used for displaying the player information of the opposing teamsare formed on either side of the score display area 221.

The sub-display control function unit 591 controls the display areas 222and 223 so that the photos of the faces and the names (Romajirepresentation for Japanese players) of the players of the two teams aredisplayed in the display areas 222 and 223.

In addition, the sub-display control function unit 591 forms a facephoto display area 224 for each of the players so that the face photodisplay area 224 is selectable. For example, the selected face photodisplay area 224 is highlighted.

Furthermore, when the sub-display control function unit 591 displays thename and uniform number of at least one of the players in the maindisplay area 210, the sub-display control function unit 591 highlightsthe face photo display area 224 of the player.

As used herein, the term “highlight” refers to displaying an area with aluminance higher than that of the other areas.

For example, when a particular player is selected in the sub-displayarea and if the cursor control function unit 592 receives a cursorsetting command CMD from the microcomputer 58, the cursor controlfunction unit 592 displays a cursor so that the cursor surrounds aplayer in the field displayed in the main display area 210 using theplayer position information.

FIG. 6 illustrates a screen in which a cursor CSL is set on a selectedplayer.

As shown in FIG. 6, when, for example, a particular player is selectedin the sub-display area, the cursor control function unit 592 sets thecursor CSL on the player in the field displayed in the main display area210 so that the cursor surrounds the player on the basis of the playerposition information.

After placing the cursor CSL on the selected player, if the cursorcontrol function unit 592 receives a movement command CMD from themicrocomputer 58, the cursor control function unit 592 moves the cursorCSL in a direction indicated by the movement command CMD. The directioncorresponds to one of all directions determined by a user operation of amovement instruction switch of the remote commander 60.

After placing the cursor CSL on the selected player, if the cursorcontrol function unit 592 receives a zoom-in command CMD from themicrocomputer 58, the cursor control function unit 592 zooms in on theplayer indicated by the cursor CSL and the vicinity of the player by azoom factor indicated by the zoom-in command. The zoom factor isdetermined by a user operation of a zoom switch of the remote commander60.

FIG. 7 illustrates a first example of a zoom-in operation performed on aplayer selected using the cursor CSL. FIG. 8 illustrates a secondexample of a zoom-in operation performed on a player selected using thecursor CSL.

As shown in FIGS. 7 and 8, after placing the cursor CSL on the selectedplayer, if the cursor control function unit 592 receives the zoom-incommand CMD, the cursor control function unit 592 zoom in the playerselected using the cursor CSL in the screen.

In the first example shown in FIG. 7, a displayed image in the maindisplay area 210 is enlarged. In contrast, in the second example shownin FIG. 8, the size of a displayed image in the main display area 210remains the same. However, a sub-display area 230 is formed on the rightside of the drawing, and a zoom-in image of an area selected by thecursor CSL is displayed in the sub-display area 230.

The cursor control function unit 592 has a function of changing thezoom-in display image to the normal display image when the cursorcontrol function unit 592 receives a zoom-in cancel command.

The cursor control function unit 592 further has a function of, uponreceiving a cursor setting command for a ball from the microcomputer 58,setting the cursor CSL on the ball so that the cursor surrounds theball.

FIG. 9 illustrates a screen in which the cursor CSL is set on a ball.

As shown in FIG. 9, upon receiving a cursor setting command CMD for aball BL from the microcomputer 58, the cursor control function unit 592sets the cursor CSL on the ball BL so that the cursor surrounds the ballBL.

Once the cursor CSL is set on a player PLY or the ball BL, the cursorcontrol function unit 592 automatically tracks, using a trackingfunction of the automatic tracking control function unit 593, the playerPLY or the ball while placing the cursor CSL on the player PLY or theball BL.

For example, as shown in FIG. 9, once the cursor control function unit592 places the cursor CSL on the player PLY or the ball BL, theautomatic tracking control function unit 593 causes the cursor CSL totrack the selected player PLY or ball BL. According to this trackingfunction, it is not necessary that the user's eyes seriously chase theplayer PLY or the ball BL and, therefore, the user can view a desiredgame scene in a relaxed state.

Upon receiving a player information display command CMD, the playerinformation control function unit 594 displays, in the vicinity of theheads of players located within a predetermined area at the center ofwhich is the ball BL, the names and uniform numbers of the players onthe basis of the position information IBLP, the player positioninformation IPLYP, and the player information IPLY.

If the player information control function unit 594 has received acommand CMD containing a selected team name (Team A or Team B), theplayer information control function unit 594 displays the names anduniform numbers of the players in the vicinity of the heads of theplayers of the selected Team A or Team B located within thepredetermined area, at the center of which is the ball BL.

The reason why the player information control function unit 594 displaysthe names and uniform numbers of only the players located within apredetermined area, at the center of which is the ball BL, is asfollows.

During game play, the user may want to know which player is at whichlocation. If the names and uniform numbers are displayed in the vicinityof the heads of all of the players, the screen becomes messy and,therefore, it is difficult for the user to easily view the screen.Accordingly, the names and uniform numbers of only players who possiblyreceive the ball are displayed.

FIG. 10 is a diagram illustrating an example in which the names anduniform numbers of only players located in the vicinity of the ball aredisplayed.

If the player information control function unit 594 has received acommand CMD containing a selected team name (Team A or Team B), the usermanually selects one of Team A and Team B. Thereafter, as shown in FIG.10, the player information control function unit 594 displays theuniform numbers and names of the players in the vicinity of the heads ofthe players of the selected team located in the vicinity of the ball.

In the example shown in FIG. 10, the uniform numbers and names ofplayers 10, 11, and 3 of Team A located in the vicinity of the ball aredisplayed.

In addition, the photo of the faces of the players having the displayeduniform numbers and names are highlighted in the face photo display area224 of the sub-display area 220.

Upon receiving an offside line display command CMD, the offside linecontrol function unit 595 displays the offside line in the main displayarea 210 on the basis of the field information IFLD, the ball positioninformation IBLP, the player position information IPLYP, and the playerinformation IPLY.

Upon receiving a ball trajectory display command CMD, the balltrajectory control function unit 596 displays a ball trajectory in themain display area 210 on the basis of the field information IFLD, theball position information IBLP, the player position information IPLYP,and the player information IPLY.

Note that the offside line and the ball trajectory can be displayed onthe screen at the same time or can be selectively and separatelydisplayed.

FIG. 11 is a diagram illustrating a first example in which an offsideline and a ball trajectory are displayed. FIG. 12 is a diagramillustrating a second example in which an offside line and a balltrajectory are displayed.

In FIGS. 11 and 12, an offside line LOFSD and a ball trajectory LTRBLare displayed in the same screen at the same time. In FIG. 11, forexample, players on Team A are moving towards the goal of Team B (onoffense), and only one offside line LOFSD is displayed. FIG. 12illustrates a scene in which Team A and Team B are playing offence anddefense in the midfield. Accordingly, in FIG. 12, two offside linesLOFSD are displayed.

As can be seen from FIGS. 11 and 12, the offside line LOFSD is not athin line (a simple line), such as a field line. The offside line LOFSDhas a width W that is substantially the same as the length of the strideof a player. For example, the offside line LOFSD is displayed with asemi-transparent color.

Unlike video captured by a fixed camera, TV broadcast video includesmoving images obtained through panning, tilting, and zoom operations.Accordingly, if the offside line LOFSD is formed with a thin line, suchas a field line, it may be difficult for the viewers to recognize theoffside line LOFSD. Thus, according to the present embodiment, theoffside line LOFSD has a certain width. In this way, the viewers caneasily recognize the offside line LOFSD at any viewing angle and watchthe soccer game with a high realistic sensation.

The recording and reproducing control function unit 597 receives theaudio signal AUD from the audio decoding circuit 52 and generates anexcitation graph that represents the level of excitation of onlookersalong a time line of the video using the audio level of cheers.

The recording and reproducing control function unit 597 associates thegenerated excitation graph with time information, the player informationIPLY, the player position information IPLYP, and the field informationIFLD and records the excitation graph in the recording and reproducingunit 80 together with the video of the game.

The recording and reproducing control function unit 597 further has afunction of, upon receiving information indicating game broadcastinterruption, such as a halftime break, from the microcomputer 58,displaying the game video recorded in the recording and reproducing unit80 together with a live image, the player information, and theexcitation graph.

FIG. 13 illustrates an exemplary excitation video screen generated bythe recording and reproducing unit 80 and displayed on the displaydevice 20.

In order to display the excitation video screen, the recording andreproducing control function unit 597 forms, in the display area 21 ofthe display device 20, a video playback sub-area 240, a live imagesub-area 250, a player information display sub-area 260, and anexcitation graph display sub-area 270.

The excitation video screen can be displayed by displaying various videoand information in the video playback sub-area 240, the live imagesub-area 250, the player information display sub-area 260, and theexcitation graph display sub-area 270 formed in the display area 21 ofthe display device 20.

The video playback sub-area 240 accounts for about 60 to 80 percent ofthe display area 21. The game video recorded in the recording andreproducing unit 80 is played back in the video playback sub-area 240.

For example, as shown in FIG. 13, the recording and reproducing controlfunction unit 597 lays out the live image sub-area 250, the playerinformation display sub-area 260, and the excitation graph displaysub-area 270 on top of each other on the right side of the display area21 so that each of the live image sub-area 250, the player informationdisplay sub-area 260, and the excitation graph display sub-area 270 isparallel to the video playback sub-area 240.

In the example shown in FIG. 13, the live image sub-area 250, the playerinformation display sub-area 260, and the excitation graph displaysub-area 270 are sequentially formed from the top to the bottom of thedisplay area 21.

When the ongoing game broadcast is changed to a commercial (CM) videoduring, for example, a halftime break, the ongoing game broadcast isdisplayed in the live image sub-area 250. In this way, the viewers canwatch the recorded video together with the live image.

The recording and reproducing control function unit 597 forms a displaysub-sub area 261 for each player in the player information displaysub-area 260. For example, a photo of the face of one of the players ofthe teams and the name of the player (Romaji representation for aJapanese player) are displayed in the display sub-sub area 261.

In the display sub-sub area 261, the photo of the face of the selectedplayer is displayed with lighter highlighting. The team name isdisplayed to the left of the photo. The name and the uniform number ofthe player are displayed to the right of the photo.

A selected player whose information is displayed in the playerinformation display sub-area 260 can be changed by the viewer (the user)by operating, for example, an up-down key of the remote commander 60.

The recording and reproducing control function unit 597 reads, from therecording and reproducing unit 80, an excitation graph 271 thatrepresents the level of the excitation along the time line of thecurrent broadcast game by using, for example, the level of cheers.Thereafter, the recording and reproducing control function unit 597displays the excitation graph 271 in the excitation graph displaysub-area 270.

The viewer can select one of predetermined periods in the time line ofthe excitation graph 271 by operating, for example, a left-right key ofthe remote commander 60. The excitation graph 271 in the selected periodis highlighted with a frame.

In addition, the excitation graph 271 is displayed so as to representthe excitation level of the game in a spectrum fashion. Furthermore, fora period for which a player selected and displayed in the playerinformation display sub-area 260 is being displayed in the game video,the excitation graph 271 is displayed with a highlight as indicated by areference symbol “HLT”.

The recording and reproducing control function unit 597 basicallyperforms control so as to display, in the video playback sub-area 240,the recorded video corresponding to the period selected using framehighlighting in the excitation graph 271 displayed in the excitationgraph display sub-area 270.

Accordingly, the user can select any player displayed in the playerinformation display sub-area 260. Thereafter, the user can use a cursorand select a highlighted and high-excitation period of the excitationgraph 271 displayed in the excitation graph display sub-area 270.

With such an operation, the user can immediately display, in the videoplayback sub-area 240, video corresponding to a period for which adesired player appears and the onlookers of the game are excited.

The present embodiment has been described with reference to the case inwhich recorded video corresponding to the period selected using ahighlight frame in the excitation graph 271 displayed in the excitationgraph display sub-area 270 is played back in the video playback sub-area240. However, a method for playing back video in the video playbacksub-area 240 is not limited thereto. For example, video in which aplayer selected in the player information display sub-area 260 appearsmay be displayed in the video playback sub-area 240 if desired.

As described above, according to the present embodiment, by using thecontrol function of the recording and reproducing control function unit597, periods in which a selected player appears is indicated byhighlight frames in the spectrum along the time line. By selecting oneof the periods having a high excitation level using the cursor, playbackof the corresponding video can be immediately started.

The remote commander 60 has a function of wirelessly transmitting, tothe microcomputer 58 of the control unit 50, a channel selection commandand a variety of display control commands regarding a game using, forexample, infrared light.

When the user operates the remote commander 60, an infrared lightcommand that instructs one of a variety of operations performed by thecontrol unit 50 serving as a TV receiver is input to the light receivingunit 70. Thereafter, the command is converted into an electrical signaland is input to the microcomputer 58.

When a command signal received from the remote commander 60 is a signalinstructing selection of a particular channel, the microcomputer 58outputs a channel selection command corresponding to the signal to theTV tuner 51.

When a command signal received from the remote commander 60 is a signalinstructing display control regarding a game, the microcomputer 58outputs a command CMD corresponding to the signal to the OSD controlcircuit 59.

FIGS. 14A to 14D illustrate an exemplary configuration of the remotecommander 60 according to the present embodiment. FIG. 14A is a frontview of the remote commander 60. FIGS. 14B and 14C are side views of theremote commander 60. FIG. 14D is a back view of the remote commander 60.

The remote commander 60 includes a power switch 61, a channel up-downswitch 62, and a volume up-down switch 63.

The power switch 61 is disposed on one of the side surfaces. The powerswitch 61 is operated in order to power on or off the TV receiver.

The channel up-down switch 62 is operated in order to change the currentTV channel to the previous TV channel or the next TV channel.

The volume up-down switch 63 is operated in order to increase ordecrease the output audio level.

Note that the remote commander 60 includes number keys thereon. However,the number keys are not shown in FIGS. 14A to 14D. For example, thenumber keys are used to select a TV channel corresponding to the number.

The remote commander 60 further includes a four-way stick switch unit64, a first function ON/OFF switch 65, a second function ON/OFF switch66, a third function ON/OFF switch 67, and Team A changeover switch 68on the back side.

The four-way stick switch unit 64 includes a peripheral ring portion 641and a push button 642 disposed at the center of the four-way stickswitch unit 64. The ring portion 641 includes four buttons that allow afour-way stick to provide four functions. For example, the lower rightbutton can serve as a zoom function button. The four switches alsofunction as UP, DOWN, LEFT, and RIGHT keys for moving the cursor CSLupwards, downwards, leftwards, and rightwards, respectively.Furthermore, the zoom level can be determined in accordance with anamount of pushing of the push button 642.

The first function ON/OFF switch 65 is operated in order to turn on oroff the player information display function.

The second function ON/OFF switch 66 is operated in order to turn on oroff the offside line display function and the ball trajectory displayfunction.

The third function ON/OFF switch 67 is operated in order to turn on oroff the live image display function, the player information displayfunction, the excitation graph display function, and the recorded videodisplay function.

The team changeover switch 68 is disposed on the back side of the remotecommander 60 in the upper section. For example, the team changeoverswitch 68 is operated in order to select one of Team A and Team B whichare opponents of a soccer game.

The recording and reproducing unit 80 associates the received video withthe excitation graph, the time information, the player information IPLY,the player position information IPLYP, and the field information IFLDand records the video. In addition, the recording and reproducing unit80 displays the live image and reproduces the player information IPLYand the excitation graph as well as playing back the recorded gamevideo.

An exemplary operation performed by the display control apparatus 10according to the present embodiment is described with reference to aflowchart shown in FIG. 15.

After a user operates the power switch 61 of the power switch 61 so asto power on the display control apparatus 10 (step ST1), the useroperates the number keys or the channel up-down switch 62 so as toinstruct the display control apparatus 10 to select a predetermined TVchannel (step ST2).

In this way, a command signal output from the remote commander 60 isinput to the microcomputer 58 via the light receiving unit 70 of thecontrol unit 50.

Upon receiving the command signal, the microcomputer 58 outputs, to theTV tuner 51, a TV channel selection command for selecting a TV channelthat broadcasts, for example, a soccer TV game. Upon receiving the TVchannel selection command, the TV tuner 51 selects a predetermined TVchannel. Subsequently, the TV tuner 51 outputs the audio signal to theaudio decoding circuit 52 and the video signal to the video decodingcircuit 53.

The video signal is decoded by the video decoding circuit 53 and is sentto the display device 20 via the superimposing circuit 54. Thus, animage based on the decoded video signal is displayed on the displaydevice 20. In addition, the audio decoding circuit 52 decodes the audiosignal and outputs the decoded audio signal to the speaker 30.

In this way, the soccer TV broadcast is displayed on the display device20 (step ST3), and the TV audio signal is output from the speaker 30.

In addition, the video signal PCTR decoded by the video decoding circuit53 is supplied to the player information acquiring unit 55, the fieldinformation acquiring unit 56, and the position information acquiringunit 57.

The player information acquiring unit 55 acquires the ball gameinformation included in the broadcast video signal, such as the playerinformation IPLY regarding players (start players and reserve players)of the two soccer teams. Thereafter, the player information acquiringunit 55 stores the player information IPLY in a storage unit (not shown)(step ST4).

The acquired and stored player information IPLY is supplied to the fieldinformation acquiring unit 56 and the OSD control circuit 59.

The field information acquiring unit 56 acquires the field informationIFLD from an unedited TV broadcast video of a soccer game using acorrespondence between a line in an input image and a field model.Thereafter, the field information acquiring unit 56 stores the fieldinformation IFLD (step ST5). Subsequently, the field informationacquiring unit 56 supplies the acquired and stored field informationIFLD to the field information acquiring unit 56 and the OSD controlcircuit 59.

The position information acquiring unit 57 acquires, from the videosignal PCTR of the soccer TV broadcast, the position information IBLPregarding a ball located inside or outside the field using the fieldinformation IFLD and the position information IPLYP regarding each ofthe players on the basis of the field information IFLD and the playerinformation IPLY (steps ST6 and ST7). Thereafter, the positioninformation acquiring unit 57 supplies the acquired ball positioninformation IBLP and the player position information IPLYP to the OSDcontrol circuit 59.

In addition, the recording and reproducing control function unit 597 ofthe OSD control circuit 59 receives the audio signal AUD from the audiodecoding circuit 52, the player information IPLY, the player positioninformation IPLYP, the field information IFLD, and the ball positioninformation IBLP. The recording and reproducing control function unit597 generates an excitation graph that represents the level ofexcitation of onlookers along a time line of the video using the audiolevel of cheers (step ST8). Thereafter, the recording and reproducingcontrol function unit 597 associates the generated excitation graph withtime information, the player information IPLY, the player positioninformation IPLYP, and the field information IFLD and records theexcitation graph in the recording and reproducing unit 80 together withthe video of the game (step ST9).

At that time, if a user who watches the soccer TV broadcast selects afavorite mode and submits a command to display player information usingthe remote commander 60, processing shown in FIG. 16 is performed.

Upon receiving the command, the microcomputer 58 submits a sub-displaycommand CMD to the sub-display control function unit 591 of the OSDcontrol circuit 59. The sub-display control function unit 591 displays apredetermined sub-area of the display area including the photos of thefaces and the names of the players for each of the teams via thesuperimposing circuit 54 (step ST10). In such a case, for example, asshown in FIG. 5, the sub-display area 220 is formed and displayed in thelower section of a main display area 210 in a display area 21 of thedisplay device 20. For example, the photos of the faces and the names(Romaji representation for Japanese players) of the players of each ofthe two teams are displayed.

When the user selects the face photo display area 224 in which afavorite player displayed in the sub-display area 220 is to be displayedusing the UP, DOWN, LEFT, and RIGHT keys (step ST11), the face photodisplay area 224 of the favorite player is highlighted, for example.

Thereafter, for example, a particular player is selected in thesub-display area, and the OSD control circuit receives a cursor settingcommand CMD from the microcomputer 58.

Thus, the cursor control function unit 592 of the OSD control circuit 59displays the cursor CSL so that the cursor CSL surrounds the player inthe field displayed in the main display area 210 (step ST12).

At that time, if the user instructs to move the cursor CSL using the UP,DOWN, LEFT, and RIGHT keys of the remote commander 60, a movementcommand CMD is input from the microcomputer 58 to the OSD controlcircuit 59 (step ST13).

Upon receiving the movement command CMD from the microcomputer 58, thecursor control function unit 592 moves, using the superimposing circuit54, the cursor CSL in a direction indicated by the movement command CMD(step ST14). The direction corresponds to one of all directionsdetermined by a user operation of a movement instruction switch of theremote commander 60.

In addition, if the user performs a predetermined key operation on thefour-way stick switch unit 64 of the remote commander 60 and instructs azoom operation and the zoom level using the push button 642, a zoom-incommand CMD is input from the microcomputer 58 to the OSD controlcircuit 59 (ST15).

In this way, the cursor control function unit 592 receives the zoom-incommand from the microcomputer 58, and the cursor control function unit592 zooms in the player indicated by the cursor CSL by a zoom factorindicated by the zoom-in command using the superimposing circuit 54(step ST16).

In this case, as shown in FIG. 7, the image displayed in the maindisplay area 210 is magnified.

Alternatively, as shown in FIG. 8, the size of a displayed image in themain display area 210 remains the same. However, the sub-display area230 is formed on the right side of the drawing, and a zoom-in image ofan area selected by the cursor CSL is displayed in the sub-display area230.

At that time, if the user submits a zoom-in cancel instruction using theremote commander 60, a zoom-in cancel command CMD is input from themicrocomputer 58 to the OSD control circuit 59 (step ST17).

Upon receiving the zoom-in cancel command CMD from the microcomputer 58,the cursor control function unit 592 changes the zoom-in display imageto the normal display image (step ST18).

In addition, as in the case of the cursor setting on a player, when theuser submits a cursor setting instruction for the ball BL, theprocessing as shown in FIG. 17 is performed.

When the cursor setting instruction is submitted, the OSD controlcircuit 59 receives a cursor setting command CMD for a ball BL from themicrocomputer 58. Upon receiving the cursor setting command CMD, thecursor control function unit 592 of the OSD control circuit 59 placesthe cursor CSL on the ball BL displayed in the field in the main displayarea 210 so that the cursor CSL surrounds the ball BL (steps ST20 andST21).

At that time, if the user instructs to move the cursor CSL using the UP,DOWN, LEFT, and RIGHT keys of the remote commander 60, a movementcommand CMD is input from the microcomputer 58 to the OSD controlcircuit 59 (step ST22).

Upon receiving the movement command CMD from the microcomputer 58, thecursor control function unit 592 moves, using the superimposing circuit54, the cursor CSL in a direction indicated by the movement command CMD(step ST23). The direction corresponds to one of all directionsdetermined by a user operation of a movement instruction switch of theremote commander 60.

In addition, if the user performs a predetermined key operation on thefour-way stick switch unit 64 of the remote commander 60 and instructs azoom operation and the zoom level using the push button 642, a zoom-incommand CMD is input from the microcomputer 58 to the OSD controlcircuit 59 (ST24).

In this way, the cursor control function unit 592 receives the zoom-incommand from the microcomputer 58, and the cursor control function unit592 zooms in the ball BL indicated by the cursor CSL by a zoom factorindicated by the zoom-in command using the superimposing circuit 54(step ST25).

In this case, as shown in FIG. 9, the image displayed in the maindisplay area 210 is magnified.

At that time, if the user submits a zoom-in cancel instruction using theremote commander 60, a zoom-in cancel command CMD is input from themicrocomputer 58 to the OSD control circuit 59 (step ST26).

Upon receiving the zoom-in cancel command CMD from the microcomputer 58,the cursor control function unit 592 changes the zoom-in display imageto the normal display image (step ST27).

When, as illustrated by the flowchart in FIG. 16 or 17, a cursor isplaced on a player or a ball, the automatic tracking process is started,as illustrated by the flowchart in FIG. 18.

If a player PLY or a ball BL is selected for the cursor control functionunit 592 by using the cursor CSL (step ST30), the player PLY or the ballBL is automatically tracked using the tracking function of the automatictracking control function unit 593 (step ST31). At that time, theautomatic tracking control function unit 593 moves the cursor CSL sothat the cursor CSL automatically follows the player PLY or the ball BL.

When the user submits an automatic tracking cancel instruction using theremote commander 60, an automatic tracking cancel command CMD is inputfrom the microcomputer 58 to the OSD control circuit 59 (step ST32).Upon receiving the automatic tracking cancel command CMD from themicrocomputer 58, the cursor control function unit 592 changes thedisplay image to the normal display image (step ST33).

In addition, when the user submits a player information displayinstruction using the first function ON/OFF switch 65 of the remotecommander 60, the processing as shown in FIG. 19 is performed.

When the player information display instruction is submitted, a playerinformation display command CMD is input from the microcomputer 58 tothe OSD control circuit 59. Upon receiving the player informationdisplay command CMD (step ST40), the player information control functionunit 594 of the OSD control circuit 59 selects players located within apredetermined area, at the center of which is the ball BL, on the basisof the ball position information IBLP, the player position informationIPLYP, and the player information IPLY (step ST41). Thereafter, if theplayer information control function unit 594 has received a command CMDcontaining a selected team name (Team A or Team B), the playerinformation control function unit 594 displays the names and uniformnumbers of the players in the vicinity of the heads of the players ofthe selected Team A or Team B located within the predetermined area, atthe center of which is the ball BL (step ST42).

If the player information control function unit 594 has received acommand CMD containing a selected team name (Team A or Team B), the usermanually selects one of Team A and Team B. Thereafter, as shown in FIG.10, the player information control function unit 594 displays theuniform numbers and names of the players in the vicinity of the heads ofthe players of the selected team located in the vicinity of the ball.

In the example shown in FIG. 10, the uniform numbers and names ofplayers 10, 11, and 3 of Team A located in the vicinity of the ball aredisplayed.

In addition, the photo of the faces of the players having the displayeduniform numbers and names are highlighted in the face photo display area224 of the sub-display area 220.

In addition, when the user who is watching a TV broadcast of a soccergame submits an offside-line and ball-trajectory display instructionusing the second function ON/OFF switch 66 of the remote commander 60,the processing as shown in FIG. 20 is performed.

When the offside-line and ball-trajectory display instruction issubmitted, the OSD control circuit 59 receives an offside-line andball-trajectory display command CMD from the microcomputer 58 (stepST50).

The offside line control function unit 595 of the OSD control circuit 59receives an offside-line display command CMD, while the ball trajectorycontrol function unit 596 of the OSD control circuit 59 receives aball-trajectory display command CMD.

Upon receiving the offside-line display command CMD, the offside linecontrol function unit 595 displays the offside line in the main displayarea 210 using the superimposing circuit 54 on the basis of the fieldinformation IFLD, the ball position information IBLP, the playerposition information IPLYP, and the player information IPLY (step ST51).

Note that, unlike a field line which is a thin line, the offside lineLOFSD is displayed so as to have a width that is substantially the sameas the length of the stride of a player, for example.

In addition, upon receiving a ball trajectory display command CMD, theball trajectory control function unit 596 displays a ball trajectory inthe main display area 210 on the basis of the field information IFLD,the ball position information IBLP, the player position informationIPLYP, and the player information IPLY (step ST52).

For example, as shown in FIGS. 11 and 12, the offside line LOFSD and theball trajectory LTRBL are displayed in the same screen at the same time.In FIG. 11, for example, players on Team A are moving towards the goalof Team B (on offense), and only one offside lines LOFSD is displayed.FIG. 12 illustrates a scene in which Teams A and B are playing offenceand defense in the midfield. Accordingly, in FIG. 12, two offside linesLOFSD are displayed.

When the OSD control circuit 59 receives information indicating a breakin the soccer TV broadcast (e.g., a halftime break) from themicrocomputer 58, the processing as shown in FIG. 21 is performed.

Subsequently, as shown in FIG. 21, when the user who is watching TVbroadcast of a soccer game operates the third function ON/OFF switch 67of the remote commander 60 (step ST60), the processing shown in stepsST61 to ST67 is performed.

At that time, as shown in FIG. 13, the recording and reproducing controlfunction unit 597 forms, in the display area 21 of the display device20, the video playback sub-area 240, the live image sub-area 250, theplayer information display sub-area 260, and the excitation graphdisplay sub-area 270.

Thereafter, the recording and reproducing control function unit 597displays the live image, the player information, and the excitationgraph together with the video of the game recorded in the recording andreproducing unit 80 (steps ST61 to ST64).

When the ongoing game broadcast is changed to a commercial (CM) videoduring, for example, a halftime break, the current broad cast video isdisplayed in the live image sub-area 250.

The recording and reproducing control function unit 597 forms a displaysub-sub area 261 for each player in the player information displaysub-area 260. For example, a photo of the face of one of the players ofthe teams and the name of the player (Romaji representation for aJapanese player) are displayed in the display sub-sub area 261.

In the display sub-sub area 261, the photo of the face of the selectedplayer is displayed with lighter highlighting. The team name isdisplayed to the left of the photo. The name and the uniform number ofthe player are displayed to the right of the photo.

The recording and reproducing control function unit 597 reads, from therecording and reproducing unit 80, an excitation graph 271 thatrepresents the level of the excitation along the time line of thecurrent broadcast game by using, for example, the level of cheers.Thereafter, the recording and reproducing control function unit 597displays the excitation graph 271 in the excitation graph displaysub-area 270.

In addition, for a period for which a player selected and displayed inthe player information display sub-area 260 is being displayed in the TVbroadcast video, the excitation graph 271 is displayed with a highlightas indicated by a reference symbol “HLT”.

At that time, the user selects a desired player to be displayed in theplayback video using the UP/DOWN keys of the remote commander 60 (stepST65). Thereafter, the user operates the RIGHT/LEFT keys of the remotecommander 60 and selects a highlighted and high-excitation period of theexcitation graph 271 for which the selected player appears (step ST66).

Upon receiving the selection command, the recording and reproducingcontrol function unit 597 displays the recorded video corresponding tothe selected period in the video playback sub-area 240 (step ST67). Notethat the selected period is highlighted with a frame in the excitationgraph 271 displayed in the excitation graph display sub-area 270 and,during the period, the selected player appears in the video.

With such an operation, the user can immediately display, in the videoplayback sub-area 240, video corresponding to a period for which adesired player appears and the onlookers of the game are excited.

As described above, according to the present embodiment, the controlunit 50 provides the following various functions.

That is, the control unit 50 has a function of acquiring, from broadcastvideo information, player information regarding a player of a gameincluded in a broadcast video signal, for example, a soccer game. Thecontrol unit 50 further has a function of acquiring field informationusing a correspondence between a line in the broadcast video and a fieldmodel.

Furthermore, the control unit 50 has a function of acquiring playerposition information regarding a player's position from the video signalon the basis of the player information and the field information. Stillfurthermore, the control unit 50 has a function of acquiring informationregarding the position of a ball serving as a moving object to bepropelled in the game from the video signal on the basis of the fieldinformation and a function of displaying the player information on thedisplay device 20.

In this case, the control unit 50 has a function of arranging aplurality of player information items and displaying the playerinformation items in part of the display area of the display device 20.In addition, the control unit 50 can display the player information foreach team. The control unit 50 can display a player information itemindicated by a cursor in a different way from the other playerinformation items (e.g., highlight display).

Furthermore, the control unit 50 has a function of placing a cursor on aplayer selected by provided player information and displayed on thedisplay device 20 using the player position information.

Still furthermore, the control unit 50 has a function of placing acursor on a ball that is selected to be indicated by the cursor.

Yet still furthermore, the control unit 50 has a function of, uponreceiving an instruction to display player information, displaying theplayer information in the vicinity of the player on the basis of theball position information, the player position information, and theplayer information. At that time, the control unit 50 can display theplayer information in the vicinity of each of the players located in apredetermined area at the center of which is the ball. If one of theteams is selected, the control unit 50 can display the playerinformation regarding the selected team.

Still furthermore, the control unit 50 has a function of, after a cursoris placed on an object, such as a player or a ball, automaticallytracking the object when the object moves. Upon receiving a zoominstruction, the control unit 50 including an auto tracking controlfunction sub-unit can enlarge and display at least the area indicated bythe cursor.

That is, according to the present embodiment, when the user watches TVbroadcast video, the user can acquire video including desired additionalinformation.

In addition, if the user selects a desired player in the playerinformation selection screen, a cursor is automatically set on theobject. If the cursor is set on a player or a ball, the player or theball can be automatically tracked or can be zoomed in. Accordingly, theuser can select and display desired additional information with an easyoperation.

Yet still furthermore, the control unit 50 has a function of forming aline associated with the ball position, such as an offside line ofsoccer or a trajectory of the ball, using the ball position information,the player position information, the player information, and the fieldinformation. At that time, the control unit 50 has a function of formingan offside line having a predetermined width, not a simple line.

Accordingly, the viewers can easily recognize the offside line at anyviewing angle and watch the soccer game with a high realistic sensation.

Yet still furthermore, the control unit 50 has a function of receivingthe audio signal in the television broadcast signal and creating anexcitation graph indicating an excitation level of the broadcast gamewith respect to a time line of the broadcast video. The control unit 50has a function of associating the created excitation graph with timeinformation and the player information and recording the excitationgraph in the recording and reproducing unit 80 together with the videoof the game.

The control unit 50 has a function of, upon receiving informationindicating game interruption, such as a halftime break, instructing thedisplay device 20 to display a live image, the player information, andthe excitation graph together with the video of the game recorded in therecording and reproducing unit 80.

The control unit 50 has a function of selectively displaying theexcitation graph for each of predetermined periods of time in the timeline or selectively displaying the player information items. Uponreceiving an instruction to select the periods in which a selected anddisplayed player appears in the broadcast video, the control unit 50plays back and displays the recorded video for the selected periods.

In this way, according to the present embodiment, periods in which aselected player appears is indicated by highlight in the spectrum alongthe time line. In addition, periods of a high-excitation scene can beidentified by the spectrum. By selecting, using the cursor, one of theperiods that have a high excitation level and in which the selectedplayer appears, playback of the video corresponding to the period can beimmediately started.

While the present embodiment has been described with reference to asoccer game, the present invention can be applied to other games, suchas rugby games and hockey games. In addition, the control function ofthe recording and reproducing control function unit 597 is applicable tovideo of a mass game and a theater play as well as a game using a movingobject, such as a ball.

In addition, the above-described method can be provided as a programthat represents the above-described processing sequence and that isexecuted by a computer, such as a central processing unit (CPU).

Furthermore, such a program can be configured so as to be stored in arecording medium (e.g., a semiconductor memory, a magnetic disk, anoptical disk, or a floppy disk (trade name)) and be accessed andexecuted by a computer including the recording medium mounted therein.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

1. A display control apparatus comprising: a receiving unit configuredto receive a television broadcast signal containing at least remotebroadcast image information; a display unit configured to display imageinformation contained in the television broadcast signal; a recordingand reproducing unit configured to record and reproduce the imageinformation; a player information acquiring unit configured to acquire,from the remote broadcast image information, player informationregarding players in a sports game included in a broadcast image signal;and a recording and reproducing control function unit configured toreceive an audio signal contained in the television broadcast signal andgenerate an excitation graph representing a level of excitation of thebroadcast sports game along a time line of the image; wherein therecording and reproducing control function unit associates the generatedexcitation graph with the image of the sports game, time information,and the player information and records the generated excitation graph,the image of the sports game, the time information, and the playerinformation in the recording and reproducing unit, and wherein, uponreceiving information indicating a break in the sports game, therecording and reproducing control function unit instructs the displayunit to display the excitation graph together with the image of thesports game recorded in the recording and reproducing unit, wherein theexcitation graph comprises one or more predetermined periods, andwherein when a player is designated, the excitation graph includes anindication of each predetermined period of the excitation graph thatcorresponds to the player's appearance in the images of the televisionbroadcast.
 2. The display control apparatus according to claim 1,wherein the recording and reproducing control function unit instructsthe display unit to display the player information and the excitationgraph together with the image of the sports game recorded in therecording and reproducing unit.
 3. The display control apparatusaccording to claim 2, wherein the recording and reproducing controlfunction unit instructs the display unit to display a live imagetogether with the image of the sports game, the player information, andthe excitation graph recorded in the recording and reproducing unit. 4.The display control apparatus according to any one of claims 1 to 3,wherein the recording and reproducing control function unit instructsthe display unit to display the excitation graph so that one ofpredetermined time periods along the time line of the graph isselectable.
 5. The display control apparatus according to claim 4,wherein the recording and reproducing control function unit instructsthe display unit to display the player information so that the playerinformation regarding one of the players is selectable, and wherein,upon receiving an instruction to select a time period for which theselected and displayed player appears in the broadcast image, therecording and reproducing control function unit reproduces the recordedimage corresponding to the selected time period and instructs thedisplay unit to display the reproduced image.
 6. A display controlmethod comprising the steps of: receiving a television broadcast signalcontaining at least remote broadcast image information; displaying imageinformation contained in the television broadcast signal on a displayunit; acquiring, from the remote broadcast image information, playerinformation regarding players in a sports game included in a broadcastimage signal; receiving an audio signal contained in the televisionbroadcast signal and generating an excitation graph representing a levelof excitation of the broadcast sports game along a time line of theimage; associating the generated excitation graph with the image of thesports game, time information, and the player information and recordingthe generated excitation graph, the image of the sports game, the timeinformation, and the player information in a recording and reproducingunit; and upon receiving information indicating a break in the sportsgame, displaying, on the display unit, the excitation graph togetherwith the image of the sports game recorded in the recording andreproducing unit, wherein the excitation graph comprises one or morepredetermined periods, and wherein when a player is designated, theexcitation graph includes an indication of each predetermined period ofthe excitation graph that corresponds to the player's appearance in theimages of the television broadcast.
 7. The display control methodaccording to claim 6, wherein the excitation graph is displayed so thatone of predetermined time periods along the time line of the graph isselectable.
 8. The display control method according to claim 7, whereinthe player information is displayed so that the player informationregarding one of the players is selectable, and wherein, upon receivingan instruction to select a time period for which the selected anddisplayed player appears in the broadcast image, the recorded imagecorresponding to the selected time period is reproduced and displayed.9. A non-transitory computer-readable medium having stored thereon acomputer-readable program, the program comprising: program code forcausing a computer to execute a display control process, the displaycontrol process including the steps of receiving a television broadcastsignal containing at least remote broadcast image information,displaying image information contained in the television broadcastsignal on a display unit, acquiring, from the remote broadcast imageinformation, player information regarding players in a sports gameincluded in a broadcast image signal, receiving an audio signalcontained in the television broadcast signal and generating anexcitation graph representing a level of excitation of the broadcastsports game along a time line of the image, associating the generatedexcitation graph with the image of the sports game, time information,and the player information and recording the generated excitation graph,the image of the sports game, the time information, and the playerinformation in a recording and reproducing unit, and, upon receivinginformation indicating a break in the sports game, displaying, on thedisplay unit, the excitation graph together with the image of the sportsgame recorded in the recording and reproducing unit, wherein theexcitation graph comprises one or more predetermined periods, andwherein when a player is designated, the excitation graph includes anindication of each predetermined period of the excitation graph thatcorresponds to the player's appearance in the images of the televisionbroadcast.